Optimal control of conditioned processes with feedback controls

نویسندگان

چکیده

We consider a class of closed loop stochastic optimal control problems in finite time horizon, which the cost is an expectation conditional on event that process has not exited given bounded domain. An important difficulty probability conditionates strategy decays as grows. The optimality conditions consist system partial differential equations, including Hamilton-Jacobi-Bellman equation (backward w.r.t. time) and (forward Fokker-Planck for law conditioned process. two equations are supplemented with Dirichlet conditions. Next, we discuss asymptotic behavior horizon tends to +?. This leads new kind problem driven by eigenvalue related continuity boundary. prove existence latter. also propose numerical methods supplement various theoretical aspects simulations. Étant donné un domaine borné ?, considère des problèmes de contrôle en boucle fermée et fini, pour lesquels le coût est une espérance conditionnée par fait que processus reste dans ?. Une difficulté importante vient du la probabilité l'évènement qui conditionne stratégie tend rapidement vers 0 quand variable temporelle l'infini. Les d'optimalité consistent système couplant équation Fokker-Planck. Ces deux équations sont complétées sur frontière On étudie ensuite comportement asymptotique l'horizon Ceci conduit à problème d'un aux valeurs propres associé continuité avec Dirichlet. prouve l'existence solutions ce nouveau type problème. aussi méthodes numériques illustre les théoriques

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Optimal Integral State Feedback Control of HCCI Combustion Timing

Homogenous Charge Compression Ignition (HCCI) engines hold promise of high fuel efficiency and low emission levels for future green vehicles. But in contrast to gasoline and diesel engines, HCCI engines suffer from lack of having direct means to initiate combustion. A combustion timing controller with robust tracking performance is the key requirement to leverage HCCI application in production ...

متن کامل

Thermodynamics of quantum-jump-conditioned feedback control.

We consider open quantum systems weakly coupled to thermal reservoirs and subjected to quantum feedback operations triggered with or without delay by monitored quantum jumps. We establish a thermodynamic description of such systems and analyze how the first and second law of thermodynamics are modified by the feedback. We apply our formalism to study the efficiency of a qubit subjected to a qua...

متن کامل

A class of stochastic optimal control problems in Hilbert spaces: BSDEs and optimal control laws, state constraints, conditioned processes

We consider a nonlinear controlled stochastic evolution equation in a Hilbert space, with a Wiener process affecting the control, assuming Lipschitz conditions on the coefficients. We take a cost functional quadratic in the control term, but otherwise with general coefficients that may even take infinite values. Under a mild finiteness condition, and after appropriate formulation, we prove exis...

متن کامل

An Approximation to Discrete Optimal Feedback Controls

We study discrete solutions of nonlinear optimal control problems. By value functions , we construct difference equations to approximate the optimal control on each interval of " small " time. We aim to find a discrete optimal feedback control. An algorithm is proposed for computing the solution of the optimal control problem. 1. Introduction and statement of the problem. For nonlinear analytic...

متن کامل

Optimal Design of Experiments for Modeling Processes with Feedback Control Variables

Feedback control schemes have been widely used in many engineering applications for a long time. Despite this, there has been very little work done on eecient design of experiments for modeling feedback control processes in order to select the appropriate feedback variables. This paper considers a general statistical formulation of this problem and studies the properties of optimal designs in t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal de Mathématiques Pures et Appliquées

سال: 2021

ISSN: ['0021-7824', '1776-3371']

DOI: https://doi.org/10.1016/j.matpur.2020.07.014